View Issue Details

IDProjectCategoryView StatusLast Update
0001739T99X171.00 SKB EaglexTS certificationpublic2023-07-24 12:15
Reporter(ALTech) Younkwang Jung Assigned To(ALTech) Younkwang Jung Due Date2023-06-16 13:41
PrioritynormalSeveritys4-minorReproducibilityalways
Status closedResolutionfixed 
Summary0001739: [Smart3][ATV10][ATV12] GTS - GtsMediaTestCases Fail in GTS 10_r4
DescriptionHi Kerwin

The GTS GtsMediaTestCasesFail issue in GTS 10_r4 has been resolved by Amlogic.
https://jira.skbroadband.com/projects/AMANDROIDS/issues/AMANDROIDS-114

Please proceed with GtsMediaTestCases after applying the patchs belows. ( attached picture )
These can be applied to ATV10/ATV12. (Common Patchs)

Please let me know the result after the test.

Thank you.
YK.Jung
TagsNo tags attached.
Attach Tags

Users monitoring this issue

User List (ALTech) JunGyu Kim , (ALTech) SY Yoon

Activities

(ALTech) Younkwang Jung

2023-06-13 12:43

developer  

image.png (19,287 bytes)   
image.png (19,287 bytes)   

(ALTech) Younkwang Jung

2023-06-13 14:38

developer   ~0013350

HI Jason

AML reported the information incorrectly.
The above patches are for ATV12.

I will send the patchs for ATV10 as soon as I get it.

Thank you
YK.Jung

(SW) Jason Ling

2023-06-13 15:39

developer   ~0013354

Hi YK,

After applying the patches, the result still fails

run gts -m GtsMediaTestCases -t com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60

06-13 15:36:18 I/ModuleListener: [1/1] SKBFXYU4133L com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60 FAILURE: android.media.NotProvisionedException: Failed to open session: ERROR_DRM_NOT_PROVISIONED
============================== Beginning of DRM Plugin Log ==============================
  06-13 16:36:18.159 I found instance=clearkey version=android.hardware.drm@1.4::IDrmFactory
  06-13 16:36:18.159 I found instance=default version=android.hardware.drm@1.0::IDrmFactory
  06-13 16:36:18.159 I found instance=playready version=android.hardware.drm@1.4::IDrmFactory
  06-13 16:36:18.159 I found instance=widevine version=android.hardware.drm@1.4::IDrmFactory
  06-13 16:36:18.162 W [device_files.cpp(1701):RetrieveHashedFile] File does not exist: path = /data/vendor/mediadrm/IDM1013/L3/usgtable.bin
  06-13 16:36:18.162 E [device_files.cpp(1559):RetrieveUsageTableInfo] Unable to retrieve usage table file
  06-13 16:36:18.162 W [usage_table_header.cpp(200):RestoreTable] Could not retrieve usage table
============================== End of DRM Plugin Log ==============================

(ALTech) Younkwang Jung

2023-06-13 16:49

developer   ~0013357

Hi Jason

I have reported it to AML.

feedback is
AML is requesting to proceed with the entire test using the command below.
run gts -m GtsMediaTestCases

This means that the FXN will fail if only the following test is performed
"run gts -m GtsMediaTestCases -t com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60"

and AML is saying that if FXN proceed with the entire test, FXN will get a pass.

So please test using the command below
"run gts -m GtsMediaTestCases"

Thank you
YK.Jung

(SW) Jason Ling

2023-06-13 19:23

developer   ~0013366

Hi YK,

Regarding the GTS failures, before I apply the patch

if I run the single test case, I'll get the following failure,
06-13 15:36:18 I/ModuleListener: [1/1] SKBFXYU4133L com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60 FAILURE: android.media.NotProvisionedException: Failed to open session: ERROR_DRM_NOT_PROVISIONED
============================== Beginning of DRM Plugin Log ==============================
  06-13 16:36:18.159 I found instance=clearkey version=android.hardware.drm@1.4::IDrmFactory
  06-13 16:36:18.159 I found instance=default version=android.hardware.drm@1.0::IDrmFactory
  06-13 16:36:18.159 I found instance=playready version=android.hardware.drm@1.4::IDrmFactory
  06-13 16:36:18.159 I found instance=widevine version=android.hardware.drm@1.4::IDrmFactory
  06-13 16:36:18.162 W [device_files.cpp(1701):RetrieveHashedFile] File does not exist: path = /data/vendor/mediadrm/IDM1013/L3/usgtable.bin
  06-13 16:36:18.162 E [device_files.cpp(1559):RetrieveUsageTableInfo] Unable to retrieve usage table file
  06-13 16:36:18.162 W [usage_table_header.cpp(200):RestoreTable] Could not retrieve usage table
============================== End of DRM Plugin Log ==============================

if I run the whole module, some test video will be stuck at the last frame.
and It happens randomly in different test case as follows,
com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With240P60
com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With720P60
com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60
com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3WithUHD60

After apply Amlogic today's patch, I still can see this symptom randomly.
You can told Amlogic Korean FAE to monitor OTT-44245, it's Amlogic internal Jira number.

Their RD said there are something wrong in Google streaming server, they are waiting Google's reply.

Thanks,
Jason

(SW) Jason Ling

2023-06-13 19:30

developer   ~0013367

Hi YK,

Please check the attachments,
The test video will be stuck at the last frame, Please refer to symptom.png
And test result will failure because timeout occur.

Thanks,
Jason
symptom .jpg (106,508 bytes)   
symptom .jpg (106,508 bytes)   
timeout.jpg (65,695 bytes)   
timeout.jpg (65,695 bytes)   

(ALTech) Younkwang Jung

2023-06-14 08:09

developer   ~0013370

Hi Jason

> Is the issue below caused by not being provisioned?
As far as I know, only the FXN model is not provisioning.
This could be a serious matter, so please check it.
=======================================================
06-13 15:36:18 I/ModuleListener: [1/1] SKBFXYU4133L com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60 FAILURE: android.media.NotProvisionedException: Failed to open session: ERROR_DRM_NOT_PROVISIONED
============================== Beginning of DRM Plugin Log ==============================
  06-13 16:36:18.159 I found instance=clearkey version=android.hardware.drm@1.4::IDrmFactory
  06-13 16:36:18.159 I found instance=default version=android.hardware.drm@1.0::IDrmFactory
=======================================================

> About video struck issue
  I reported it to AML
  https://jira.skbroadband.com/browse/AMANDROIDS-115
    
> About GtsMediaTestCases
  Please proceed with the all GtsMediaTestCases and let me know the results

Thank you
YK.Jung

(SW) Jason Ling

2023-06-14 08:32

developer   ~0013372

Hi YK,

>>As far as I know, only the FXN model is not provisioning.
incorrect, you can check the original Jira, I don't know which manufacturer reported it, but their log is not provisioning.

Currently, according to Amlogic comment, we can NOT run "Single" item, if we run the single item, I think all manufacturer will get the same log "ERROR DRM NOT PROVISIONED" whether we apply the patch or not.

so if need to retry this failure, we should run the whole gts module
run gts -m GtsMediaTestCases
or run the the package
run gts -m GtsMediaTestCases -t com.google.android.media.gts.WidevineVP9WebMPlaybackTests

Thanks,
Jason

(SW) Jason Ling

2023-06-14 19:13

developer   ~0013381

Hi YK,

Our QA run the GtsMediaTestCases today, the 1st round, we have 4 failures,
com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With240P60
com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With720P60
com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3With1080P60
com.google.android.media.gts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL3WithUHD60

Our QA retry again and again, each round might eliminate one failure (but not 100%), please check the history.jpg

The final result in today, we still have one failure. I think we should clarify it before submit the FW to 3PL.. (ATV10 also have this issue)
Because we can't guarantee that we can get all passed results within 3~4 retries. There is a 2 minute timeout for every failure, which is a huge waste of time for 3PL. I don't have strong reason to ask 3PL to retry again and again.

For the problem of being stuck on the last frame, as far as I know, Amlogic RD has created an issue tracker to discuss with Google.
Please ask Korea Amlogic FAE to track this issue.

Thanks,
Jason
1st.jpg (421,481 bytes)
history.jpg (93,080 bytes)   
history.jpg (93,080 bytes)   

(SW) Jason Ling

2023-06-15 08:35

developer   ~0013383

Hi YK,

Our QA finished the GtsMediaTestCases test with 6 times retries
if the certification is Self-Test, I think it is OK. but if the certification is on 3PL side, I think these cases are not stable.

For ATV10, We'll do the certification on 3PL side, please ask Amlogic to keep track this issue.

Thanks,
Jason

(ALTech) Younkwang Jung

2023-06-15 15:51

developer   ~0013390

Last edited: 2023-06-15 15:51

View 2 revisions

Hi Jason

Amlogic did a Google test on GtsMediaTestCases for BFX-AT100(ATV10) and
The test result is pass.
Test FW is v15.536.32

In the case of ATV10, it seems that it is possible to prepare for Google approval through self-build?
Do you happen to have any other Google issues at ATV10 ?
Please check it

Thank you
YK.Jung
image-2.png (110,659 bytes)   
image-2.png (110,659 bytes)   

(ALTech) Younkwang Jung

2023-06-15 18:28

developer   ~0013391

Hi Jason

setprop vendor.media.omx.out_buffer1 10
setprop vendor.media.omx.out_buffer2 20

AML FAE says that if you test it after setting up the above property, it will pass more stably
Please check it. (ATV10 / ATV12 are both the same)

Thank you
YK.Jung

(SW) Jason Ling

2023-06-15 21:50

developer   ~0013394

Hi YK

>>setprop vendor.media.omx.out_buffer1 10
>>setprop vendor.media.omx.out_buffer2 20

>>AML FAE says that if you test it after setting up the above property, it will pass more stably

This information that Amlogic QA has verified last week, it was not work, so Amlogic RD created the issue tracker to discuss with Google

Now this issue is under discussion.
Please ask Amlogic FAE to monitor monitor OTT-44245.

Thanks,
Jason

(ALTech) Younkwang Jung

2023-06-16 08:53

developer   ~0013397

Hi Jason

The current high priority is Google approval through ATV10 3PL. (UI536 FXN self-build version)
So I asked AML for quick support for ATV10
As a result, I received the result that GtsMediaTestCases was passed by GTS_10_r4 ATV10.
( I received the test result from AML after setting below.)
setprop vendor.media.omx.out_buffer1 10
setprop vendor.media.omx.out_buffer2 20

What you're saying is
When the Google test was conducted with ATV10 at FXN, the results of GtsMediaTestCases (GTS 10_r4) were Fail
Please send me the failed content(log and test result)
we have to double check with AML.

Thanks
YK.Jung

(SW) Jason Ling

2023-06-16 09:53

developer   ~0013402

Hi YK,

the user build have no permission to
setprop vendor.media.omx.out_buffer1 10
setprop vendor.media.omx.out_buffer2 20

BFX-AT100:/ $ setprop vendor.media.omx.out_buffer1 10
Failed to set property 'vendor.media.omx.out_buffer1' to '10'.

3PL do not accept setprop. unless we have the strong reason to convince 3PL. (e.g. skip dns)

Currently, this issue is under discussion between Amlogic and Google, Before clarifying, I have built 15.536.60-self-0615 to our QA, they started test from Yesterday.
/release_by_fxn/tmp/15.536.60-self-0615

if Google said that this is known issue, After our QA compete the pretest, we can submit the self-build to 3PL directly.

>>Please send me the failed content(log and test result)
The test result I've sent to Amlogic Taiwan FAE, the symptom is video get stuck at last frame, Amlogic Taiwan FAE said other manufacturer also reported it.
That is why I ask Amlogic Korean FAE to monitor their internal Jira OTT-44245.

Thanks,
Jason

(SW) Jason Ling

2023-06-19 10:28

developer   ~0013430

Hi YK,

For your information, Amlogic Taiwan FAE shared the attachment to us this morning.

Thanks,
Jason
gts.png (178,455 bytes)   
gts.png (178,455 bytes)   

(ALTech) Younkwang Jung

2023-06-20 15:19

developer   ~0013468

Hi jason

Aml FAE says the new GTS 10 r4 tool is built.
Could you check the existing failed item with this new tool "GTS 10 r4 build (10344474 or later)" at ATV10 (self-build version) ?

Thank you
YK.Jung

(SW) Jason Ling

2023-06-20 15:40

developer   ~0013469

Hi YK,

I don't know where to download this version, I'll ask to our 3PL.

Thanks,
Jason

(SW) Jason Ling

2023-06-20 16:39

developer   ~0013472

Hi YK,

I've checked it with our 3PL. they also don't have permission to get GTS daily build.

The GTS daily/test build is provided by Google. It's not public. If Soc vendor can share it. I can help verify.

We need GTS10 R4 (10344474) for (ATV10), (ATV11-13) => 2 zip files for ATV10 and ATV12.

I am checking it with Aml Taiwan FAE, but I can not guarantee if he has permission to share this file to us.

Thanks,
Jason

(ALTech) Younkwang Jung

2023-06-26 09:44

developer   ~0013492

Hi Jason

I just received a message from AML that a new Google internal version tool has been released

new GTS tool "the android-gts-11-R1(11-14)-Preview17-10324228.zip"

Please use this tool to check ATV10(high priroity)/ATV12 for GTS Fail and let me know the result after the test

Thank you
YK.Jung

(SW) Jason Ling

2023-06-26 10:07

developer   ~0013494

Hi YK,

>>I've checked it with our 3PL. they also don't have permission to get GTS daily build.
>>The GTS daily/test build is provided by Google. It's not public. If Soc vendor can share it. I can help verify.

Please ask Soc vendor to provide the tool.

Thanks,
Jason

(SW) Jason Ling

2023-06-26 13:35

developer   ~0013497

Hi YK,

I run the GtsMediaTestCases with android-gts-11-R1(11-14)-Preview20-10361901.zip
the class WidevineVP9WebMPlaybackTests has been removed. so we can not verify it, Is it correct? Please check it with AML.

Thanks,
Jason
GtsMediaTestCases.jpg (961,620 bytes)

(ALTech) Younkwang Jung

2023-06-26 14:35

developer   ~0013498

Hi Jason

The AML FAE says it has been changed to the command below.

run gts -m WvtsDeviceTestCases -t com.google.android.wvts.WidevineVP9WebMPlaybackTests#testVP9WebMCencSubSampleL1WithUHD60

Please check it.

Thank you
YK.Jung

(SW) Jason Ling

2023-06-26 17:43

developer   ~0013500

Hi YK,

I use the following command, please check the attachment
run gts -m WvtsDeviceTestCases -t com.google.android.wvts.WidevineVP9WebMPlaybackTests

first run: 2 failures, and we take 2 times retry to eliminate the failures.

By the way, Google changed the test case name in preview tool.
so we can not use the preview tool's result to eliminate the failure in current tool. (because test case name are different)

We still need to spend time retrying and retrying until we can get past all the failures.

Thanks,
Jason
WvtsDeviceTestCases.jpg (814,398 bytes)

(ALTech) JunGyu Kim

2023-06-27 12:35

developer   ~0013509

Last edited: 2023-06-27 12:40

Hi Jason,

1. Amlogic wants the test report (zip file) and log when the result is all passed.
Could you please share test report and log file.

2. Additionally, they want the report file and log when first run (when 2 failures).

3. Also can you share that the screen capture the google system when fail contents is still remain?

Thank you.
Kim

(SW) Jason Ling

2023-06-27 19:35

developer   ~0013514

Hi JunGyu,

1. Please refer to WidevineVP9WebMPlaybackTests-report.zip/WidevineVP9WebMPlaybackTests-log.zip

2. I test it again this afternoon, we get all pass at the first run

3. please refer to GoogleSystem.jpg. I used GTS 10_R4 to run gts -m WvtsDeviceTestCases -t com.google.android.wvts.WidevineVP9WebMPlaybackTests
There are 4 failures (get stuck at the last frame => timeout)

Then I used android-gts-11-R1(11-14)-Preview20-10361901.zip to run gts -m WvtsDeviceTestCases -t com.google.android.wvts.WidevineVP9WebMPlaybackTests. The report is clean.
I uploaded the both reports. As you can see, the failures still be shown. (expected result is the failures will be move to "Aggregated Pass" section, but the module name is different, so the 1st run failure can not be eliminated by 2nd run clean report).

Thanks,
Jason
GoogleSystem.jpg (190,957 bytes)   
GoogleSystem.jpg (190,957 bytes)   

(ALTech) JunGyu Kim

2023-06-28 09:01

developer   ~0013515

Hi Jason,

To solve third issue, please contact 3PL with above information.
Amlogic recognize this issue and they are contacting Google to solve this problem. But they want to push 3PL together to solve this issue quickly.

Thank you.
Kim

(ALTech) Younkwang Jung

2023-06-30 12:31

developer   ~0013535

Hi Jason

It's Google feedback. ( AML updated to jira. )
https://jira.skbroadband.com/browse/AMANDROIDS-115

Thank you
YK.Jung
image-3.png (85,535 bytes)   
image-3.png (85,535 bytes)   

(SW) Jason Ling

2023-07-04 09:09

developer   ~0013551

Hi YK,

We've run the android-gts-11-R1(11-14)-Preview20-10361901.zip with 15.537.42
There is an Incomplete Modules "GtsAdServicesTestCases", please check the attachment

Analysis:
Failed to parse APK file: /data/local/tmp/GtsAdServicesTestCases.apk: Requires newer sdk version #33 (current version is #31)

It looks like this module only works on Android 14 (SDK#33) device, but our device is Android 12 (SDK#31)
Please forward to Amlogic to confirm if this is known issue, can we ignore it ?

Thanks,
Jason

(ALTech) Younkwang Jung

2023-07-04 12:44

developer   ~0013556

Hi Jason

I received the following feedback from AML FAE.
===========================================================
auto-waiver 처리 건으로 보입니다.
from Harman feedback
they said those failed will be autowaive when upload the report to APA
===========================================================
Can you double check on FXN's 3PL for this part?

Thank you
YK.Jung
image-4.png (11,682 bytes)   
image-4.png (11,682 bytes)   

(SW) Jason Ling

2023-07-05 16:29

developer   ~0013572

Hi YK,

We uploaded the GTS preview build report (15.537.54) to Google System
The system doesn't show the any failure/warning about Incomplete Modules.
so I think we can ignore it. (Incomplete Modules "GtsAdServicesTestCases")

Thanks,
Jason

Issue History

Date Modified Username Field Change
2023-06-13 12:43 (ALTech) Younkwang Jung New Issue
2023-06-13 12:43 (ALTech) Younkwang Jung Status new => assigned
2023-06-13 12:43 (ALTech) Younkwang Jung Assigned To => (SW) Kerwin Chen
2023-06-13 12:43 (ALTech) Younkwang Jung File Added: image.png
2023-06-13 12:43 (ALTech) Younkwang Jung Issue Monitored: (ALTech) SY Yoon
2023-06-13 12:44 (ALTech) Younkwang Jung Issue Monitored: (ALTech) JunGyu Kim
2023-06-13 12:46 (ALTech) Younkwang Jung Description Updated View Revisions
2023-06-13 13:33 (SW) Kerwin Chen Assigned To (SW) Kerwin Chen => (SW) Jason Ling
2023-06-13 14:38 (ALTech) Younkwang Jung Note Added: 0013350
2023-06-13 15:39 (SW) Jason Ling Note Added: 0013354
2023-06-13 16:49 (ALTech) Younkwang Jung Note Added: 0013357
2023-06-13 19:23 (SW) Jason Ling Note Added: 0013366
2023-06-13 19:30 (SW) Jason Ling Note Added: 0013367
2023-06-13 19:30 (SW) Jason Ling File Added: symptom .jpg
2023-06-13 19:30 (SW) Jason Ling File Added: timeout.jpg
2023-06-14 08:09 (ALTech) Younkwang Jung Note Added: 0013370
2023-06-14 08:32 (SW) Jason Ling Note Added: 0013372
2023-06-14 19:13 (SW) Jason Ling Note Added: 0013381
2023-06-14 19:13 (SW) Jason Ling File Added: 1st.jpg
2023-06-14 19:13 (SW) Jason Ling File Added: history.jpg
2023-06-15 08:35 (SW) Jason Ling Note Added: 0013383
2023-06-15 15:51 (ALTech) Younkwang Jung Note Added: 0013390
2023-06-15 15:51 (ALTech) Younkwang Jung File Added: image-2.png
2023-06-15 15:51 (ALTech) Younkwang Jung Note Edited: 0013390 View Revisions
2023-06-15 18:28 (ALTech) Younkwang Jung Note Added: 0013391
2023-06-15 21:50 (SW) Jason Ling Note Added: 0013394
2023-06-16 08:53 (ALTech) Younkwang Jung Note Added: 0013397
2023-06-16 09:53 (SW) Jason Ling Note Added: 0013402
2023-06-19 10:28 (SW) Jason Ling Note Added: 0013430
2023-06-19 10:28 (SW) Jason Ling File Added: gts.png
2023-06-20 15:19 (ALTech) Younkwang Jung Note Added: 0013468
2023-06-20 15:40 (SW) Jason Ling Note Added: 0013469
2023-06-20 16:39 (SW) Jason Ling Note Added: 0013472
2023-06-26 09:44 (ALTech) Younkwang Jung Note Added: 0013492
2023-06-26 10:07 (SW) Jason Ling Note Added: 0013494
2023-06-26 13:35 (SW) Jason Ling Note Added: 0013497
2023-06-26 13:35 (SW) Jason Ling File Added: GtsMediaTestCases.jpg
2023-06-26 14:35 (ALTech) Younkwang Jung Note Added: 0013498
2023-06-26 17:43 (SW) Jason Ling Note Added: 0013500
2023-06-26 17:43 (SW) Jason Ling File Added: WvtsDeviceTestCases.jpg
2023-06-27 12:35 (ALTech) JunGyu Kim Note Added: 0013509
2023-06-27 12:40 (ALTech) JunGyu Kim Note Edited: 0013509
2023-06-27 19:35 (SW) Jason Ling Note Added: 0013514
2023-06-27 19:35 (SW) Jason Ling File Added: WidevineVP9WebMPlaybackTests-report.zip
2023-06-27 19:35 (SW) Jason Ling File Added: WidevineVP9WebMPlaybackTests-log.zip
2023-06-27 19:35 (SW) Jason Ling File Added: GoogleSystem.jpg
2023-06-28 09:01 (ALTech) JunGyu Kim Note Added: 0013515
2023-06-30 12:31 (ALTech) Younkwang Jung Note Added: 0013535
2023-06-30 12:31 (ALTech) Younkwang Jung File Added: image-3.png
2023-07-04 09:09 (SW) Jason Ling Note Added: 0013551
2023-07-04 09:09 (SW) Jason Ling File Added: GtsAdServicesTestCases-report.zip
2023-07-04 12:44 (ALTech) Younkwang Jung Note Added: 0013556
2023-07-04 12:44 (ALTech) Younkwang Jung File Added: image-4.png
2023-07-05 16:29 (SW) Jason Ling Note Added: 0013572
2023-07-07 16:04 (SW) Jason Ling Assigned To (SW) Jason Ling => (ALTech) Younkwang Jung
2023-07-07 16:19 (SW) Jason Ling Status assigned => resolved
2023-07-07 16:19 (SW) Jason Ling Resolution open => fixed
2023-07-24 12:15 (ALTech) Younkwang Jung Status resolved => closed